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Abstract 

We present a result on topologically equivalent integral metrics (Rachev, 1991, Miiller, 
1997) that metrize weak convergence of laws with common marginals. This result is relevant 
for applications, as shown in a few simple examples. 
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1 Introduction 

In applications, it is often necessary to resort to approximations in the study of the properties of 
stochastic models. The original process can be replaced by a simpler one whose characteristics 
are already known or easier to study. This requires some stability of the model, which is usually 
represented in terms of integral probability metrics (Rachev, 1991, Miiller, 1997). Among the 
many possible situations, a typical one is the difficulty to deal with the dependence properties 
of stochastic processes. For example, the study of the central limit problem for the standardised 
partial sum of dependent random variables requires the introduction of dependence conditions 
(mixing conditions, e.g. Doukhan, 1994, or weak dependence conditions, e.g. Doukhan and 
Louhichi, 1999). These dependence conditions are used to relate past and future realisations 
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of some stochastic process with some ''independent version": an example in the text, below, 
will make this statement less elusive. In this case as in many other applications, the univariate 
marginal distributions of the approximation are the same as the original ones. When the marginal 
distributions of the original vector and the approximating one are the same, there are some results 
pertaining weak convergence metrized by integral probability metrics that have not been explored 
before. The goal of this paper is to relate the minimal generator of that metrizes weak convergence 
under an integral probability metric to more general classes of test functions. As a few examples 
show, this is particularly important when dealing with convergence rates of moments between 
the original process and the approximation. To give a simple illustration of the applications to 
be discussed below, consider X„ := (Xi„,X2„) converging weakly to X := {Xi,X2) G M^. This 
implies that for any continuous bounded function, say /, E/ (X„) Ef {X) . If / (X) is only 
uniformly integrable, the rate of convergence is not the one obtained under the Dudley metric 
(bounded Lipschitz metric), as we need to truncate. However, if law {Xin) = law {Xi) {i = 1, 2), 
under some conditions on /, the results of this paper show that truncation is not necessary and 
a tighter bound can be achieved. In particular, / may even be discontinuous for the convergence 
of moments of / to be satisfied and the marginal laws can be arbitrary as long as they are in 
common. No structure is imposed on law {Xn) and law {X) apart from the marginals being in 
common and the assumed weak convergence. 

Below we give some background information also to set up the notation (Section 2). Then, 
the result of the paper is stated (Section 3) followed by some applications (Section 4). The proofs 
are in Sections 5 and 6. 

2 Background Material and Notation 

Suppose P and Q are two laws. For a class of functions ^ we define the integral metric 



These metrics have been used by Rachev (1991) to study the stability of stochastic systems as well 
as by Miiller (1997). Suppose / is a function with domain in the metric space {X,r). Define the 
supremumnorm ||/||^ := sup^^^ 1/ and the Lipschitz norm as \\f\\^ := sup^y^^ l/W - f {y)\ /r{x,y). 
Define the bounded Lipschitz metric of / as the semimetric 11/11^^ := ||/|Ioo + II/IIl- ^^^'^ 
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a function / belongs to the class BLi := BLi {X) if H/H^^ < 1- The metric space {X,r) is 
implicit in this definition. 

When ^ := BLi, and (IPn)„gpj (Qn)„gN are two sequences of laws defined on {X,r), ^ can 
be used to metrize weak convergence of P„ and Q„ to each other (and often, Q„ = Q is fixed 
and understood as the limiting value of (]Pn)„gNu{oo})- Suppose X C and P„ and Q„ are the 
laws of Xn ■— {Xni, XnK) and X'^ :— (X^i, X'^^) such that law [Xnk) = law (X'^^f.) so that 
P„ and Q„ have the same univariate marginals. This paper gives a result about the generator 
5^ of (Ql when P„ and Q„ satisfy the just mentioned restriction. The space X will be equipped 
with the Ip distance denoted by {x,y) := (X]fc=i — yk\^] (p G [1, oo], with the obvious 
modification for p ~ oo). Finally, Mi :— Mi {X) is the class of coordinatewise nondecreasing 
functions from X to [0, 1] . 

3 Statement of Result 

When the marginals between two laws are in common, in the sense defined above, we have the 
following relationship between the generators BLi and Mi. 

Theorem 1 Suppose (Pri)„£N and (Qri)„£N have common marginals. Then, dsLi (Pn,Qn) ^ 
if and only if dM^ (Pn, (Q)„) 0. 

Remark 2 Surprisingly, the two metrics dsLi o-nd dMi are topological equivalent when P„ and 
Q„ have same marginals. Since the indicator of [x, oo) :— [xi, oo) x • • ■ x [xk, oo) is coordinatewise 
increasing, 

sup |P„ {[X, oo)) - Qn {[X, 00))| < dM, (P«, Qn) , 

so that weak convergence of sequences with common marginals is equivalent to the above uniform 
convergence. By the Portmanteau Theorem, we know that this is not true in general. 

In applications it is important to use functions that are not necessarily continuous. However, 
for actual calculations, it is much easier to compute dsLi- We give a simple illustrative example. 
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Example 3 Suppose 

oo 
s=0 

n — 1 oo 
s—Q s—n 

where (Zf)^^^ '^''"^ integrahle random variables and {Z^)^^^ is an independent copy of {Zt)^^-^. 
Hence Y^ is independent o/Yq. Consider the laws of Xn :~ (Yq^Y^) and X!^^ (Yq^Y^) , say P„ 
and Qn, where Xn and X'„ take values We have 

oo 

dBL, (P„, Qn) < Eri (X„, X'n) = E |y„ - Y;\ < 2E |Zo| ^ |a,| , 

s—n 

Eoc 
jflsl — > as n ^ cxD, Theorem^ gives dMi (IPn,Qn) — > as 
s—n 

we/L /n words, this means that the law oj Xn converges to the product of the marginals (X'n has 
independent components) and the convergence holds for the expectation of more general classes 
of functions than BLi (e.g. Remark\^. 

As the previous example shows, it is also important to relate the two metrics in order to derive 
rates of convergence. 

Theorem 4 Suppose (Pn)neN '^^'^ (*Qn)neN ^'^^ *^ Theorem^and recall that P„ and Q„ are 
defined on {^X CR^,rp) . Then, 

dm, (Pn,Qn) < min{23/2if(f-l)/(2p)dsL, (Pn,Qn)'/' , l} - 

4 Two Applications 

We give two applications. In both cases, we show that relating the integral probability metric of 
the class BLi to the class Mi allows us to derive upper bounds for integral probability metrics 
based on unbounded classes of functions, not necessarily continuous. In particular we shall define 
MRC+ := MRC+ (R) to be the class of positive nondecreasing functions on M, continuous from 
the right. 
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4.1 Integral Probability Metrics for Products of Unbounded Positive 
Functions 

Suppose 

© := I n 9k ■■ 9k e MRC+, k ^ 1, | 

is a class of functions such that each element g is the pointwise product of positive nondecreasing 
functions continuous from the right. Even if g G © is unbounded, the integral probability metric 
with respect to © can be bounded in terms of Mi (M^) and BLi (M-^^) by Theorem^ 

Corollary 5 Suppose P, Q are the laws of X , X' £ M.^ having same univariate marginals. Set 
^:=c«Afi(R^)(P,Q)A then 

« K 

de (P,Q)< / l[Qg, is)ds, 
k=i 

where Qg^ (s) = inf {x : Pr {gk {Xk) > x) < s}. 

Remark 6 By simple approximating arguments, we can extend Corollary\^from © to the convex 
hull o/ © U (— ©) , where g G ©) if —g £ ©• Details are left to the reader. 

4.2 Covariance Inequalities 

Suppose, Y and Z are two random variables. Define 

a:=a (F, Z) 2 sup |Pr (Y > y, Z > z) ~ Pi (Y > y) Pr (Z > z)| , (2) 

which is a simple version of the strong mixing coefhcient 

a{A,B) := 2 sup {Co-y (/a, /b) -.AeA^BeB}, (3) 

where A and B are two sigma algebras. Strong mixing is a commonly used dependence condition 
and limit theorem for dependent random variables are often proved using it. The coefficient a 
is the basis of Rio's covariance inequality (e.g. Rio 2000, Theorem 1.1), which is known to be 
sharp. Using the results of this paper we can prove the following extension of the just mentioned 
inequality. 

Corollary 7 Suppose {Y, Z) is a random vector with values in (R^,ri). Set 

2 min { I SdsL, (P(y,z) , FyP^) | , 1 } , 
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where P(y,z) the law of (Y, Z) and PyP^ it the product of the marginals. Suppose gY,gz G 
MRC+. Then, 

e 

Cov {gy [Y) , gz {Z)) <2 j Qg, (s) Qg, {s) ds, 



where Qg^ (s) := inf {y : Pr {Y)\ > y) < s} and Qg^ (s) inf {z : Pr {\gz {Z)\ > z) < s}. 

Remark 8 To show a similar result, Doukhan and Louhichi ( 1999, Lemma 1 ) require the marginals 
to he Lipschitz continuous. Theorem^shows that Lipschitz continuity is not necessary. In general 
the strong mixing condition is satisfied if dsLi ^ 0, and we restrict A and B in to be half 
open intervals, as in If^l . 



5 Weak Convergence with Common Marginals 

Suppose X :— {Xi, ...,Xk) ^ X C M.^ is a vector of random variables with law P and Pk :— 
law (Xk) {k = 1, K) . Then, there exists a function C : [0, 1]^ [0, 1] such that 

Pr {Xi e Ai, ...,Xk eAK) = C (Pi (Ai) , Pk (Ak)) (4) 

for Ak = [—oo,Xk] C R, {k — 1, ...,K). The function C is called copula function and the above 
representation holds even for sets more general than Ak (Scarsini, 1989). Suppose C is a copula 
distinct from C above. The distance between these two copulae can be measured in terms of an 
integral probability metric generated by a class of functions J, i.e. % (C, C") . Define 

Fk {x, v) := Pr {Xk < x) + v Pr {Xk = x) , v e [0, 1] and x eR. 

Define the operator Q* : ^ [0, 1]^ such that 

Q*X (^Fi{Xi,Vi),...,Fk{Xk,Vk)) , 

where {Vi, ...,Vk) are iid [0,1] uniform random variables independent of X. Then, U := Q*X 
is a random vector with uniform [0, 1] marginals (Riischendorf and de Valk, 1993, Proposition 
1). If Pk {k — 1, ...,K) is absolutely continuous with respect to the Lebesgue measure, from Q 
we deduce U has law C. Define also the operator Q : [0,1]^ such that for some [0,1]^ 

uniform random vector U with law C, 

QU (Pf 1 {Ui) , ...,P^i {Uk)) , (where P^^ (u) := inf {x : Pr {X < x) > u}) 

6 



so that QU = X (= is equality in distribution). Hence, if the marginals of QU are not continuous, 
the copula is not unique (e.g. Scarsini, 1989). Here, the term copula will refer to the law of 
U = Q*X, which IS unique. 

Denote Mi ^[0, 1]^^ to be the class of functions Mi, but with support in [0, 1]^; similarly, 
define BLi ^[0, 1]^^. Moreover define 

:= {5 : [0, 1]^ ^ M : 5 := / o Q, / e BL^ {X)} 

so that ® is the class of functions obtained from functions in BLi {X) using the composition of 
/ with the transformation Q. 

Lemma 9 Suppose X and X' are random variables with values in X C M.^ and laws P and Q 
having common marginals and with copula C and C respectively. Then 

dM,(x) (P,Q) = rfM,([o,i]-)(^^'C'') 

and 

dBL^W (P, Q) = (C, C) > ciBi,([o,i]-) (C, C) . 

Proof. Note that if / e Mi {X) then / o Q g Mi {[0, 1]^) and if 5 e Mi ([0, 1]^) then 
5 o Q-i G Ml {X) , where Q-^X := (Pi (Xi) , ...,Pk {Xk)) and Pk {x) := Pk ([-00, x]). This 
follows because Q is nondccrcasing. Since Q is a measurable map (if we consider the sigma 
algebras generated by Borel sets of X and [0, 1]^) by a change of variables. 



dMi{X) (IP)< 



sup 


j fd{F-q) 


= sup 


/eMi(Ar) 




/eMi(Ar) 



j foQd{C-C'] 



- '^Mi([0,l]'^) ('^''^O- 



The last equality follows because / = goQ~^ G Mi {X) (for some g G Mi ^[0, 1]^^ ), as mentioned 
above. The second part of the lemma follows by change of variables. We only need to note that 
functions in !B are bounded, but not necessarily Lipschitz unless the marginals of X are Lipschitz 
continuos. Hence, BLi {[0.1]^'^^ C «8. ■ 

For U G [0,1]^ define U = {1 — Ui, — Uk) and similarly for u G [0,1]^ define u. 
Then, C {u) := Pr {U < u) is the copula of U so that C {u) := C {u) = Pr ({/ > u) is the survival 
copula (vector inequalities are meant to hold elementwise). We recall that the copula is Lipschitz 
of order and constant one with respect to the li norm, 

K 

\C{ui, ...,uk) -C{vi, ...,vk)\ < ri {u,v) = ^\uk- Vk\ ■ (5) 

fe=i 



Since C (w) is a copula, © also implies 



\C[u)-C{v)\= C{u)-C{v) < ri (m, w) = n (u, w) 
Hence, we have the following. 
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Lemma 10 



sup 

/GAfi([04]'^) 



= sup \C{u)-C'{u)\ 



fd{C-C') 

Proof. For simplicity, suppose / (Ok) = [Qk is the K dimensional vector of zeros). Define 



where [ui, 1] :— [ui-^,1] x •■• x [u^^,!] c [0,1]"'^, u^j. < and Amfi > such that 

J2iex ^mfi < 1, i G 2r„j c and #X„i = 2™ (/{...} is the indicator function). Choosing 
{ui)-^j^ such that Amfi < c2^™ (for some bounded absolute constant c), E|/„j — /| ^ as 
m — > oo for any / £ A/i. Such a construction and its convergence can be shown by simple 
manipulation of the usual approximation of functions in terms of indicator functions (e.g. see the 
proof of Theorem 13.5 in Billingsley, 1995) together with monotonicity. Then, 

JudiC^C) = ^ A,„/, /"/{ue [u„l]}d(C-C')(w) 

< J2 [ Hue [u^, 1]} die- C) (u) . 

By continuity of C (i.e. jSl), the above display is unaffected if [ui, 1] in the definition of fm does 
not include the left boundary in any/some of the coordinates. Hence, we can regard sup„j /,„ to 
be a nondecreasing function (not necessarily right continuous). Hence, taking sup with respect 
to m and /, we deduce 



sup 

/SMi 



fdiC-C] 



< sup |Pr([/>M)-Pr(C/'>M)|= sup \C (u) - C {u)\ , 



where U and U' are uniform [0, 1]^ random vectors with law C and C respectively. The lower 
bound follows noting that the indicator of [ui, 1] C [0, 1]^ is coordinatewise increasing, where the 
same remark about the boundaries applies. ■ 

Proof of Theorem^ Suppose dBLi(x) ^n, Qn) ^ 0. By Lemma^l dBLi([o i]*') (^"' ^n) ^ 
where C„ and are the copulae corresponding to P„ and Q„. Then, by I© (i-e. continuity). 



sup \Cn{u)-C'^{u)\^Q 

^£[0,1]^ 
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and dj^j^^^Q ^jjc-j (C„, C^) by Lemma [TUl Finally, Lemma IHl implies dMi(x) (IPn,Qn) — > 0. 

Now suppose dMi(x) (IPn,Qri) ^ 0. Since the class of indicators of right half spaces are in 
Ml (A"), 

sup |Pr (X„ > x) - Pr (X,; ■>x)\< dM.ix) (P, Q) ^ 0, 

and we must have dgi^-^^^x) (Pn,Qn) ^ 0, by weak convergence (because in A:" C the sets 
[x, (x] :— [xi , oo] X ■ ■ ■ X [xK, oo] C M.^ are a separating class). ■ 

Proof of Theorem 131 At first we show that the bound holds for C„ and C^. Let / (u) :— 
I{ue [v,l]} and g,{u) := [1 - ([w, 1] , m) /e] V 0, u £ [0,lf := x ••• x [^^,1] C 

[0, 1]^). Hence, is a Lipschitz approximation of / (as e ^ 0) and such that Hgell^^ < (l + 
Noting that > /, consider the following bound, where dependence on the argument u is 
suppressed, 

fd (C„ - C;) < I g.dCn - I fdC, = J g,d (C„ - C'J + J {g, - /) dC'^ 

< (1 + e-i) dsLi([o,i]-) C'n) +J(9e- f) dC'„ 
[by the previous remarks about g^] 

< {l + e-')d^^^(^^,,y.^{Cn,C'„)+n{u',v), (8) 

for some u' G [0, 1]^ using ©. By construction, m' and v are such that 

r„ (u, u') = I > Im'i, - wtT 1 < e, 



implying, by the relations between means (i.e. ri {u,v) K ^ <rp {u,v) K ^/^), 

n (m', v) < K^-^/Prp {u', v) < K^P-^^'^e. 
Substitute this bound in ©. Noting that e < 1, choosing e to equate the two terms gives 

where we have taken sup with respect to / on both sides (/ in the class of indicators of right half 
open intervals [v, 1] C [0, 1]^^ as defined above) and we have used Lemma |10I Then, by Lemma 
El the previous display implies 

dM,(x) (Pn,Q„) = V([o,i]-) (^-C-O < 23/2if(''-i)/(2rtrf^^^^j^^^j^,^ {Cn,C'S'^ 
< 2'/'K'-r'-'^/('PUsL.ix){F,Qf\ 



By Lemma [TUl we deduce rf^^^^p i]^) ^n) — ^ ^^'^ result follows. 

6 Proof of Corollaries 

Proof of Corollary [S) For any positive function : R — > R 

oo 

gk (x) ^ J I {gk (x) > s} ds. 



Hence, suppressing the argument x for ease of notation, 
I : =y gi---gKd(P-Q) 

K °° 

= J f[ J I{gk> Sk}dskd{P-Q) 



/ dsi - ■■ dsK / IT {dk > Sk} d ( 
Jmk J ^J-^ 



by Fubini's Theorem. Then, 

K 



II : f f[l{gk > Sk}d{¥-Q) 
k=i 

< |Pr {gk {Xk) > Sk, fc = 1, .., K) - Pr {gk (X^) >Sk,k = 1, ..,K)\ 

= |Pr {Xk > gk' {sk) , fc = 1, ..^K) - Pr {X'k > g^' {sk) , fc = 1, ..,K) 
[because gk is nondecreasing and right continuous] 

< dM,iM^){P,Q)^2e, 



and 



K 



/ llHgk > Sk}d{F-Q)<2 min (Pr {gk {Xk) > si) , Pr {gK {Xk) > sk)) 
k=i 

because of the following reasons: the marginals of P and Q are the same, and 

. K . K 

Y[l{gk>Sk}dP = I{gi> si}Y[l{gk> Sk}dP 

k=l ■' k=l 

kjtl 

< minj^y I{gi >si}dP,...,J I{gK>SK}dP^ 

[because the terms in the product take values in [0, 1] 
= min (Pr (51 {Xi) > si) , Pr {gK {Xk) > sk)) ■ 
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From the previous displays, 



II < 2mm{9,Prig,{X,)> s,),...,Pr{gK{XK)> Sk)) 

K „9 K 



2/ \[l{s<Vr{gk{Xk)> Sk)}ds^2 \[l {Qg, {s) > Sk} ds, 
Jo Jo 



which imphes 

K 



I < / lldsi ■■■dsK< I TT Qg, (s) ds, 
Jm J V; 



using Fubini's Theorem. ■ 

Proof of Corollary El By Rio's covariance inequahty, 

a{gY,gz) 

Cov{gYiY),gz{Z))<2 J Qg, (s) Qg, {s) ds. 



Since gy and gz are nondecreasing and right continuous, 

sup |Pr {gy (Y) > y, gz (Z) > z) - Pr [gy (F) > y) Pr [gz [Z) > z)\ 
= sup |Pr (r > gy' {y),Z> .9^1 (z)) - Pr (F > gy' (y)) Pr (Z > g^' (z)) | , 

so, by Theorem 01 

a{gy,gz)=a{Y,Z) < 2dM, (P(y,z), PyPx) <2min{|8dBLi (P(y,z), PyPz) | , l} 
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